8 


Aversive motivation systems: fear, 
frustration and aggression 


When animals are exposed to aversive stimuli, particularly those of 187 
pain, they are likely to respond by either withdrawing from or attacking 
the source of the stimuli. ‘Pain is an anatomically developed sensory 
system genetically differentiated for survival and the defence of the 
body. Responses to painful stimuli either involve the skeletal muscula- 
ture or are internal but they are experimentally quantified as escape and 
avoidance’ (Le Magnen, 1998, p. 4). Both types of responses to this source 
serve adaptive functions. In many species, specific escape mechanisms 
have evolved for dealing with physical danger. One of the simplest is the 
withdrawal reflex that removes the organism from damaging stimuli. 
When specific taste receptors are in contact with bitter substances, they 
result in a spitting reflex that protects the organism from ingesting 
possibly toxic substances that are generally associated with the bitter 
taste. In Chapter 5 the mechanisms by which rats learn to avoid smells 
and tastes that have previously been followed by illness were examined. 
Animals will also react to aversive stimuli with attack behaviour, par- 
ticularly when escape is difficult. Such a reaction is particularly evident 
in feral animals. 


TWO-FACTOR THEORY OF AVOIDANCE BEHAVIOUR 


The standard situation or apparatus used to study responses to aversive 
stimuli is one in which a rat is placed in a shuttle box - a long narrow 
box divided in half by a partition. The floor of the box is a grid of steel 
rods that can can deliver a painful shock when activated by electricity. 
The rules of the experiment are as follows. The rat has a few seconds to 
cross the barrier over to the other side of the box. If the rat responds in 
this fashion, the buzzer goes off and nothing else happens. If the rat fails 
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to cross in time, then an electric shock is experienced and continues 
until the crossing occurs. 

In such an experiment the rat is likely not to respond during the 
first few trials when the buzzer comes on. The electric shock comes a few 
seconds later, and causes the rat to run and eventually cross over the 
barrier. Crossing the barrier turns the electrical current off, and this 
response indicates that the rat has escaped the painful shock. Over 
successive trials the escape response becomes progressively more likely. 
Although the rat may freeze or crouch when the buzzer is sounded, after 
the electric shock begins, the rat quickly makes the crossing-over re- 
sponse that turns off the electric shock. Eventually most rats will display 
the avoidance responses, that is, they run during the warning interval 
between the onset of the buzzer and that of the electric shock. This act 
prevents the shock from occurring, and eventually the animal will 
continue trial after trial, crossing over to the other side upon the onset 
of the signal, and thus never experiencing an electric shock. 

The explanation of the rat’s escape response in which it runs and 
thus terminates the electric shock following its response poses no 
particular problem. The electric shock is painful, running turns it off, 
and so running is rewarded and strengthened. Running is reinforced by 
escape from pain. We face a more difficult problem in explaining the 
process that reinforces the avoidance response, thus preventing the 
electric shock from occurring. If the absence of shock maintains continu- 
ous response, this poses the puzzle of how the absence of an event can be 
a reinforcer. How can a non-event strengthen and maintain behaviour? 
One solution is to demonstrate that avoidance behaviour is really a 
response to a stimulus and not to a non-stimulus. This type of explana- 
tion forms the basis of the two-factor theory of avoidance behaviour 
(Miller, 1948; Mowrer, 1960) which accounts for its acquisition in the 
following manner. First, the rat acquires a conditioned response, namely 
fear, to the buzzer or other warning signals. Second, the avoidance 
response reduces the fear. Thus the reinforcement for avoidance respon- 
ding is not a non-event such as the absence of an electric shock, but fear 
reduction, an event. 

This theory suggests a closer examination of events occurring 
during the early trials. The buzzer comes on and a few seconds later, the 
painful shock follows. The latter will produce many stress reactions such 
as tension in the muscles, increase in heart rate as well as breathing rate, 
and secretions of hormones from the adrenal gland. These reactions 
occur before the onset of the buzzer, but eventually, these stress re- 
sponses begin to occur in response to the buzzer. This constitutes the 
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situation under which classical or Pavlovian conditioning occurs. This is 
the first of the two factors in the two-factor theory. Stress responses such 
as muscle tension, rise in blood pressure and heart rate are, in turn, 
assumed to comprise effects that are unpleasant. These reactions may be 
regarded as the basis of an emotional state, that of fear. From this 
perspective, fear is not a mental state but an internal stimulus situation 
comprising a set of internal stimuli produced by the conditioned stress 
responses. It is also as unpleasant or aversive as the electric shock. 
Therefore, any response that terminates fear will be reinforced and 
strengthened. If the rat crosses over before the shock is administered and 
it also turns off the buzzer, the stimulus for fear is removed, and so the 
fear state ends. These events account for the reinforcement of the avoid- 
ance response. Fear reduction constitutes the second of the two factors. 

In essence, a negative-feedback loop is involved in which a stimu- 
lus (the buzzer) produces fear, which in turn, calls forth an action such 
as running that removes the fear by removing the stimulus that causes 
it. In this analysis, the avoidance response is treated not as an anticipa- 
tory response to something that has yet to happen, but as a response to 
something that has happened, namely fear produced by the buzzer. This 
analysis also treats the avoidance response as an event that is reinforced 
by something that happens, the reduction of fear, rather than as the 
result of something that does not happen. This type of explanation has 
been extended to explain irrational forms of human behaviour such as 
compulsions. Such behaviour is assumed to be motivated by fear, and 
maintained by fear reduction. The fear itself may be traced to certain 
experiences that created them, much in the way in which the electric 
shock creates fear of the buzzer in the rat. 


Problems with two-factor theory 


Research on dogs has indicated that early in avoidance training, the 
buzzer provokes fear, but later in training when the avoidance response 
has been well developed, the animal shows little evidence of fear 
(Solomon & Wynne, 1954), yet continues to make this response when the 
buzzer sounds. Subsequent studies indicated little evidence of a causal 
relationship between physiological measures of fear such as heart rate 
and changes in defensive responses (de Toledo & Black, 1966; Powell et 
al., 1971). There is another problem with the two-factor theory. In setting 
up an avoidance conditioning experiment, the response chosen by the 
experimenter as the correct one is arbitrary. According to the two-factor 
theory, any response may be chosen and the animal can learn to escape 
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or avoid the aversive stimuli associated with these acts. However, some 
responses are learned much more easily than others. These constraints 
intrigued Bolles (1970), and led to a reformulation of the theory explain- 
ing avoidance behaviour. He argued that although a pigeon may readily 
learn to jump across a treadle to avoid an electric shock, it learns to peck 
an illumination key in the apparatus to avoid getting an electric shock 
with great difficulty, if at all. The key-pecking response itself is not 
difficult for the pigeon if it is reinforced with food for doing so. But it has 
great difficulty in ever learning this response if it is reinforced through 
shock avoidance. A similar observation has been made on rats that learn 
to run in avoidance situations much more easily than they learn to press 
the lever. 

The biological explanation of the constraints on avoidance behav- 
iour proposed by Bolles (1970) points out the following. An animal comes 
to the experiment equipped with specific ways of responding to danger. 
These form a hierarchical pattern of innate reactions when the defensive 
motivation system is activated. Various response patterns, which are 
components of the system, consist of running away, freezing or attack- 
ing. The specific actions included in the system depends upon the spe- 
cies. Tortoises would withdraw into their shells rather than run, and 
birds fly away rather than run away. Thus, Bolles described and concep- 
tualised these action patterns as species-specific defensive reactions or SSDRs, 
behavioural adaptations that have evolved through natural selection as 
defence mechanisms. 

In explaining the behaviours that animals manifest in the avoid- 
ance task, Bolles (1970) argued that animals use instinctive responses in 
dealing with the situation. If one of them is effective, then that response 
is learned very quickly. If none of the SSDRs in the animal’s repertoire 
work, then, and only then, will the animals try a response that is not a 
SSDR. Under these circumstances such a response will be learned slowly, 
laboriously, and perhaps not at all. When faced with danger, a rat is 
likely to freeze. If freezing does not work, a SSDR such as running away 
may be tried, and such a response will be effective in the shuttle box. 
However, if the rat is tested in a box where a lever-pressing response is 
required, none of its SSDRs will provide a successful solution to the 
problem. Although the lever-press response with its paws is easily ac- 
quired when the outcome is food because of the association between 
scratching and the discovery of grain or seeds, it is not part of the rat’s 
instinctive repertoire of reactions to danger. 

Bolles’s (1970) conception of avoidance is very different from the 
one offered by the two-factor theory. From the former’s perspective, the 
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successful escape or avoidance of shock does not strengthen a new 
response, such as running from one place to another. The rat already is 
programmed to know how to run when threatened with danger. What 
may be learned is that this situation is dangerous, and that a specific 
member of the class of SSDRs is effective. Defensive behaviour is situ- 
ation-specific, being confined primarily to dangerous settings, and it is 
diverse in its appearance such as freezing, flight and fight. 


PAVLOVIAN CONDITIONING, ACQUIRED MOTIVATION, 
AND THE NERVOUS SYSTEM 


Although Bolles’s (1970) analysis of avoidance behaviour is a viable 
alternative to the two-factor conditioned fear explanation, analyses 
which take physiological factors into account are worth examining. One 
in particular is a model by Gray (1971, 1982, 1987) which incorporates 
material from neurophysiology and psychopharmacology. Gray pointed 
out that animals respond differently to conditioned and unconditioned 
aversive stimuli. When confronted with painful electric shock, animals 
will typically show increased activity, run, jump, scream, hiss or attack a 
suitable target such as another animal. However, they respond to a 
stimulus associated with shock by freezing and remaining silent. Gray 
suggested that the brain mechanisms mediating these two kinds of 
reactions are distinct, as are the drugs to which they are sensitive. 

Gray (1971, 1987) categorised the mechanism that reacts to uncon- 
ditioned aversive stimuli as belonging to the ‘fight/flight system’, and 
the mechanism that reacts to conditioned aversive stimuli as the ‘behav- 
ioural inhibition system’. In his analysis, Gray (1987) incorporated the 
notion, from the two-factor theory, that the aversive nature of stimuli, 
which have been followed by pain, is a necessary step in the acquisition 
of an active avoidance response. In addition, Gray drew upon research on 
‘electrical stimulation of the brain’ (Olds & Olds, 1965) indicating that 
the existence in the brain of two fundamental motivational systems - a 
‘reward’ mechanism and a ‘punishment’ mechanism. The former mech- 
anism is constructed via connections with the animal’s motor system to 
maximise stimuli that regularly precede the occurrence of its stimula- 
tion. In a similar manner, stimuli that regularly precede the occurrence 
of a punishment acquire, through Pavlovian conditioning, the ability to 
activate the punishment mechanism. Gray postulated that within the 
brain there is a ‘comparator for punishment’ which processes the conse- 
quences of its response, and through this mechanism the animal learns 
to approach safety signals associated with the omission of anticipated 
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punishment. This comparator provides information that indicates the 
mismatch between expected and received punishment. 


FEAR AND FRUSTRATION AS AVERSIVE STATES 


Gray’s (1987) model indicates the parallel between the effects of punish- 
ment and those of the omission of anticipated reward. He argued that 
‘frustration’, a state which is caused by the omission of reward, is 
functionally and physiologically very similar to the state of ‘fear’. How- 
ever, these states vary in intensity, and the intensity of the reaction 
aroused by ‘frustrative non-reward’ is usually less than that aroused by 
punishment. Gray explains the manner in which frustrative non-reward 
shares common aversive properties with punishment. An experimenter 
subjects an animal to frustrative non-reward by first rewarding it for 
performing some response on a number of trials, and then testing it on 
trials where reward is omitted. During succeeding test disinclination to 
perform this response because of the aversive properties of stimuli 
associated with frustrative non-reward. 

Most experiments have shown that the rate of extinction or re- 
sponse decrement resulting from non-reward is related to the magni- 
tude of the reward received by the animal prior to the test trials. In 
general, resistance to extinction is decreased by increments in the mag- 
nitude of reward. That is, large rewards lead to less resistance to reward 
than a small reward. This is because animals trained with a large magni- 
tude of reward exhibit a greater degree of aversive reactions to non- 
reward than do those trained with smaller magnitudes. Such an expla- 
nation suggests that responding in extinction does not merely decline 
passively, but rather is actively suppressed by the aversive property of 
non-rewarded responding. 

Wagner (1963) provided a more direct demonstration of the aver- 
sive properties of frustrative non-reward. He trained rats to run down an 
alley, but rewarded them on 50 per cent of their trials - a procedure 
referred to as a ‘partial reinforcement schedule’. On the trials when they 
were not rewarded, a distinctive stimulus (sound and light) was pres- 
ented to them as they entered the goal box. They were then tested in a 
shuttlebox, and when they jumped across the barrier, the stimulus was 
turned off. The results indicated that they jumped across the barrier more 
often than the control rats which had experienced the same stimulus in 
the runway, but not in association with the non-rewarded trials. Such 
results suggest that stimuli associated with frustrative non-reward are 
aversive in a similar manner as stimuli associated with punishment. 


Downloaded from https://www.cambridge.org/core. Cambridge University Main, on 02 Dec 2019 at 19:19:06, subject to the Cambridge Core 
terms of use, available at https: Gambrdge Books Online © Gambridge/UniversijoPress | 20405.009 


Aversive motivation systems 193 


Consider studies on the effects of a partial reinforcement (PRF) 
schedule compared with a continuous reinforcement (CRF) schedule 
involving the same number of trials on animals that were subsequently 
tested under conditions where reward is omitted altogether. A universal 
finding is that animals that are trained under the PRF schedule show 
greater resistance to extinction than those under the CRF schedule. 
Amsel (1962) developed the classic explanation of the partial reinforce- 
ment extinction effect (PREE) in terms of frustrative non-reward mech- 
anisms. His theory suggests that, as a result of non-rewarded trials, an 
animal on a PRF schedule comes to experience conditioned frustration 
during its performance of the instrumental response. This state of frus- 
tration sets up distinctive internal stimuli, which come to act as cues to 
continue performing the instrumental response, given that these cues 
are followed by a reward on the rewarded trials. Thus, the stimulus 
feedback from the internal state of frustration becomes a signal to the 
animal to maintain persistence of the formerly reinforced response. 
When reward is terminated altogether, the resulting frustration is not 
new but has been associated with non-rewarded responding in the past, 
and thus responding persists. By contrast, rats that have always experi- 
enced reward during training now encounter their first experience of 
non-reward during the extinction test trials. To the extent that non- 
reward is aversive, responding is eliminated swiftly because of compet- 
ing responses elicited by frustration. 

Just as a PRF schedule is a method of training an animal to 
continue responding despite non-rewarded encounters, it is possible to 
keep an animal responding in spite of punishment if a similar experi- 
mental arrangement is made. That is, by introducing an electric shock 
initially at a very low intensity and then gradually increasing its inten- 
sity and always following it with reward, the animal’s resistance to 
punishment can be thereby increased. Such an analysis was developed 
by Brown & Wagner (1964). It led them to conduct an experiment 
designed to show the similar behavioural effects produced by non- 
reward and punishment. They trained three groups of rats: one on a CRF 
schedule (Group C); one on a PRF schedule in which 50 per cent of the 
running responses were rewarded with food (Group PR); and a third 
group on a special punishment schedule (Group P). The third group 
received exposure to food and electric shock after they entered the goal 
box. Food was available during every trial, and the shocks were adminis- 
tered on 50 per cent of the acquisition trials. 

Following training, each of the three groups was divided into two 
subgroups for testing, one under consistent non-reward and the other 
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under a schedule wherein food and electric shock were present on each 
trial. The results indicated that exposure to either non-reward or punish- 
ment during acquisition produced resistance to any of the decremental 
effects of the test events. Group P rats tested under punishment and 
Group PR rats tested under non-reward showed little decrease in respon- 
ding. As predicted by the fear = frustration hypothesis, the Group PR 
subjects were less disrupted by punishment and Group P rats were less 
disrupted by non-reward than were the corresponding Group C subjects. 
These results indicate that partial reinforcement and gradually increas- 
ing punishment may train subjects to continue responding in the pres- 
ence of aversive cues that are different from those encountered initially. 
Thus tolerance for non-reward carries with it tolerance for punishment 
and vice versa. 


Drug studies on reactions of aversive stimuli 


The results of the Brown & Wagner (1964) study indicate functional 
similarity between aversive stimuli arising from punishment and frus- 
trative events. There are also physiological similarities underlying these 
functional effects. Alcohol can affect an animal’s behaviour in an ap- 
proach-avoidance conflict situation in which a food-deprived rat is 
trained to run to food in a goal box. When it enters the box it receives an 
electric shock and is thus punished. If the shock intensity is set at a level 
that just prevents the rat from entering the box, an injection of alcohol 
will enable the rat to maintain running behaviour (Miller, 1959). 

If there is a physiological overlap between the systems activated by 
punishment and by frustration, alcohol should also reduce frustrative 
reactions. This hypothesis can be tested by studying rats injected with 
alcohol during their acquisition of a response under the PRF schedule. 
Frustration theory suggests that rats on a PRF schedule learn to use 
internal cues of non-reward as cues for continued approach behaviour. If 
frustration is reduced, by administering the rats with drugs during 
training, certain results should follow when they are tested without the 
drug in the extinction trials. The usual difference between PRF and CRF 
groups should be abolished. This prediction was confirmed in experi- 
ments using sodium amytal by Ison & Pennes (1969) and Gray (1969). 
Identical results were found by Feldon & Gray (1981) using a different 
fear-reducing drug, chlordiazepoxide (Librium). Because rats adminis- 
tered with these drugs during training were prevented from developing 
tolerance of frustration, they were more impeded by the aversive effects 
of frustrative non-reward during the extinction trials than were control 
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rats that acquired the response under non-drug conditions. 


Neural structures and the behavioural inhibition system 


The limbic system, a series of interlinked nuclei and tracts which sur- 
round the thalamus and lie beneath the cortex, is implicated in the 
regulation of emotional reactions (MacLean, 1970). The hippocampus is a 
structure within this system and has been implicated in the analysis of 
novelty by the organism (Gray, 1971) as well as in the inhibition of 
responses to cues associated with aversive stimuli (Douglas, 1967; 
Kimble, 1968). During periods of arousal when the cortex and the reticu- 
lar arousal system register desynchronised electrical rhythms, cells in 
the hippocampal region display a narrow range frequency of firing from 
4 to 9 Hz. This pattern is referred to as the hippocampal theta wave. One of 
the functions of the hippocampus is to inhibit the activating systems of 
the lower brain upon repeated presentations of the stimulus (Kimble, 
1968). This function enables the animal to decouple its attention to new 
or More consequential environmental events. The hippocampal theta 
rhythm is blocked if an analgesic drug is injected into the animal, and its 
responsiveness to painful stimuli is simultaneously decreased (Gray, 
1970). Such results prompted Gray to propose that there is a single 
physiological system that mediates the effects of punishment and frus- 
trative non-reward, in addition to its relationship to processing of novel 
stimuli. Gray (1976) regards the physiological mechanisms mediating 
these effects as the structural basis of a behavioural inhibition system 
(BIS) which is antagonised by analgesics and barbiturate drugs. 

The septal area of the limbic system has two-way connections 
with the hippocampus and appears to lie astride the input for pain and 
novelty to the latter structure. Lesions in the medial nuclei of the 
septum abolish the hippocampal theta wave when the animal is pres- 
ented with fear-related and novel stimuli. Fig. 8.1 illustrates the effects 
of such lesions on hippocampal function. It has also been observed that 
neurons in the nuclei fire in bursts in phase with the theta rhythm. 
Gray (1971) was able to drive the hippocampal theta rhythm through 
electrodes implanted in the septal area at frequencies lying within the 
natural theta range. This led Gray to conclude that the septal area 
contains the pacemaker cells for the hippocampal theta wave. Follow- 
ing further research on this system, Gray (1987) suggested that it has 
the general task of comparing actual with expected stimuli. If actual 
stimuli are successfully matched with expected ones, it functions in a 
‘checking mode’ and behavioural control rests with the other brain 
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Fig. 8.1 Effects of septal lesion on hippocampal theta wave. (Based on 
data in Gray, 1970.) 


mechanisms. If there is a discordance between actual and expected 
stimuli (novelty input to the BIS) or if the predicted stimulus is aversive 
(‘signals of punishment’ or ‘signals of non-reward’ to the BIS), the septo- 
hippocampal system takes direct control over behaviour and operates 
in the ‘control mode’. 

In control mode, the septo-hippocampal system operates the out- 
put of the BIS with the participation of other brain structures. In this 
way, the septo-hippocampal system operates as the computational 
mechanism of the BIS, and detects anxiety-producing stimuli, thus acti- 
vating appropriate behavioural patterns. Although the functions at- 
tributed to the septo-hippocampal system are cognitive, the system plays 
a role in emotional behaviour. Gray’s (1987) model treats this system as 
an interface between emotional and cognitive processes. 
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Experiments on the BIS 


Given the role of the BIS in the reception of pain and novelty, it is not 
surprising to find that lesions to both the hippocampal and septal 
regions impair an animal’s ability to withhold a response that had been 
punished. Such lesions also affect the animal’s reactions in the non- 
reward situation. They maintain a response in the face of non-reward 
more so than non-operated control animals. Gray (1971) has shown that 
lesions in the medial septal area are the most effective in modifying the 
rat’s reactions to non-reward and punishment. 

Gray (1971) hypothesised that injections of the barbiturate, so- 
dium amobarbital, and septal-hippocampal lesions produce similar be- 
havioural effects because the septal pacemaker cells are inhibited by 
barbiturate drugs. Thus the theta wave from the hippocampus is abol- 
ished either by disruptions in septal functioning or by direct interven- 
tion of the hippocampal area. This hypothesis led Gray & Ball (1970) to 
implant recording electrodes in the dorsal hippocampus and stimulat- 
ing electrodes in the medial septal area. By stimulating the septum at 
the theta range, the experiments were able to induce or drive a 6-9 Hz 
wave in the hippocampus. They also found that the theta wave could be 
blocked by stimulating the septal area with a current of higher frequen- 
cies, in the range of 100-200 Hz. 

Once the researchers were able to induce hippocampal theta 
waves by septal stimulation, they experimented with the threshold level 
of stimulation that would produce this effect. The threshold current to 
drive theta is related to the stimulation frequency, and a minimal 
threshold was found at precisely 7.7 Hz. Anti-anxiety drugs increase the 
driving threshold selectively at 7.7 Hz, suggesting a relationship be- 
tween theta at this frequency and anxiety. Such drugs have little effect 
on other frequencies in the theta range. Because recordings from the 
hippocampus reveal theta waves in the 7.5-8.5 Hz range when rats are 
exposed to frustrative non-reward, it is not surprising that such drugs 
attenuate their behavioural approach to cues associated with this event. 

Gray (1987) proposed that 7.7 Hz theta driving mimics the central 
effects of conditioned frustration on the basis of behavioural effects 
affected by this physiological manipulation. Gray (1970) trained rats ina 
runway on a CRF schedule and divided them into various groups. The 
rats were tested under non-reward, and those in the experimental group 
were subjected to continuous theta driving while in the runway. An- 
other group was stimulated in the septal area but at frequencies differ- 
ent from those that induce the theta rhythm. A third group did not 
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receive any stimulation at all during the test trials. The results showed 
that the theta-driven rats showed a potentiation of the extinction pro- 
cess; that is, they extinguished sooner than the other groups. The other 
two groups did not differ in their rate of extinction but clearly were 
more resistant to extinction than the experimental group. 

How anti-anxiety drugs are able to prevent animals from exhibi- 
ting the PREE as well as the partial punishment effect (PPE) has been 
discussed. Since these drugs also affect the 7.7 Hz theta-driving 
threshold, the latter effect may play a causal role in explaining PREE and 
PPE. To test this hypothesis, Gray (1971) ‘injected’ 7.7 Hz theta into the 
rat’s brain through appropriate electrical stimulation of the septal 
pacemaker cells that control theta. By doing so he hoped to produce 
emotional ‘toughening up’ or behavioural tolerance to aversive stimuli 
through a sequence of theta-driving prior to test trials where the animal 
encounters aversive stimuli. Gray trained rats to run in a straight alley 
on a CRF schdule. The experimental group was given five seconds of 
theta-driving when they encountered the goal box. This was done ran- 
domly on 50 per cent of the trials. The control group was not stimulated. 
During extinction tests, both groups were left unstimulated, and the 
results indicated that the experimental group was more resistant to 
extinction than the controls. This outcome may be referred to as a 
pseudo-PREE, as shown in Fig. 8.2. 

Holt & Gray (1983) extended Gray’s (1971) findings by testing the 
animals on a different apparatus. The experimental group received 10 
days of theta-driving stimulation and the control group was given ident- 
ical training save for the stimulation. After this, the rats were trained to 
bar-press for food reward without further stimulation. The experimen- 
ters then attempted to suppress bar-pressing by extinction, punishment 
with foot-shock, or presentation of a stimulus paired with a response- 
independent foot-shock. In each of these tests the previously stimulated 
rats were more resistant to suppression of bar-pressing than the con- 
trols, even though the behavioural tests were conducted three to four 
weeks after the end of the period of brain stimulation. The fact that 
‘emotional toughening up’ was produced through theta-driving applied 
prior to behavioural training suggests that the process which gives rise 
to PREE and PRP is non-associative. 

It is possible to block hippocampal theta by high-frequency septal 
stimulation. If the critical aspect of low-frequency stimulation is that it 
drives theta, then high frequency septal stimulation should increase 
later tolerance for stress. Holt & Gray (1983) found that high-fre- 
quency, theta-blocking septal stimulation decreased the resistance of 
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Fig. 8.2 The ‘pseudo-partial reinforcement extinction effect’ induced by 
theta-driving the experimental animals on 50 per cent of their 
continuous reinforcement (CRF) trials. (Based on data in Gray, 1969.) 
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extinction of a bar-press response acquired subsequently to the period of 
stimulation. Such evidence supports the notion that low-frequency 
stimulation produces its effect because it drives theta. Gray’s (1969) 
earlier experiments with rats trained and tested in the alley also pro- 
duced results that support this notion. The rats were trained on a PRF 
schedule and received medial septal stimulation with a 200 Hz current 
during the non-rewarded trials. The control group was also trained on a 
PRF schedule but was never stimulated. The experimental group was less 
resistant to extinction than the controls. 

More recently, Williams & Gray (1996) have investigated the role of 
the frequency of the septal stimulating current and the theta rhythm 
which it elicits. Increased resistance to extinction was produced after 
stimulation at 7.7 Hz. However, when the frequency was reduced to 7.5 
Hz the behavioural effect was reversed, that is, resistance to extinction 
was reduced. This demonstrates the exquisite dependency of the behav- 
ioural effects of theta-driving upon exact frequencies of the stimulating 
current. Such a finding corresponds well with the frequency-dependence 
of the effects of the anti-anxiety drugs upon the theta-driving curve. All 
of these findings suggest that common processes may be involved. 

In general, the work by Gray and others suggests that theta fre- 
quency behaves very much like a physiological analogue of frustrative 
non-reward. The theta rhythm acts as a carrier of information and thus 
plays a critical role in the control of behaviour. Gray proposed that the 
hippocampus actively inhibits other neural structures through the re- 
petitive output in the theta frequency range. The combined evidence on 
the recording, stimulation and lesion experiments, together with the 
evidence of the selective effect of barbiturate drugs on a particular 
frequency of septal-driving on the hippocampal theta rhythm seem to be 
consistent with this hypothesis. 


THE FIGHT~FLIGHT SYSTEM AND ATTACK BEHAVIOUR 


In his conceptual nervous system concerning mechanisms dealing with 
aversive reactions, Gray (1987) made a distinction between those that 
react to unconditioned aversive stimuli and those that react to condi- 
tioned aversive stimuli. The latter forms the BIS, and the former consti- 
tutes the fight-flight system. When an animal is exposed to a punishing 
aversive stimulus, it displays unconditioned behaviour. It will either 
fight or show flight. He also distinguished between two kinds of fight: 
the defensive attack, which is delivered against a member of its own 
species or a predator; and a predatory attack delivered by a predator 
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against its prey. Such a distinction is supported by the type of aggressive 
behaviour elicited by electrical stimulation of the brain. Defensive at- 
tack is elicited by electrical stimulation of the medial hypothalamus in 
both cat and rat. In cats this behaviour is accompanied by hissing and 
erection of the hair (Masserman, 1941). This stimulation also produces 
unconditioned escape behaviour of the sort elicited by painful stimuli 
(Roberts, 1958). The unconditioned response to punishment may be 
either defensive attack or attempts at escape. 

Adams & Flynn (1966) trained cats to escape from shock by jump- 
ing onto a stool. When these animals were stimulated in the medial 
hypothalamus, they also exhibited the same escape response. Using the 
selfstimulation method for mapping the brain into zones related to 
reward value, Olds & Olds (1965) found that medial hypothalamic stimu- 
lation can act as a negative reinforcer of the rats’ operant responding. 
These animals were subjected to electrical stimulation of that area, and 
the equipment was programmed so that each bar press would terminate 
the stimulation for a specified period. Under this response-reinforce- 
ment contingency, the animals responded at a very high rate. Thus 
defensive attack behaviour may be motivated by activation of the nega- 
tive reinforcement zones in the brain. In addition, there may be another 
factor that is reinforcing such behaviour. Rats exposed to an inescapable 
electric shock when placed in pairs exhibit a reduced physiological 
response (i.e. gastric erosions, as well as ACTH release) than those 
shocked when alone (Stolk et al., 1974; Weinberg, Erskine & Levine, 1980; 
Weiss et al., 1976). The Weiss et al. (1976) study also demonstrated that 
assuming the fighting posture without having contact with the partner 
separated by a Plexiglas barrier can also reduce the aversive effects of 
shock. They suggest that fighting is a coping response because it provides 
relevant feedback in the form of self-reinforcing behaviour. In this 
respect, Weinberg et al. (1980) consider fighting to be a consummatory 
response similar to others such as eating, drinking and mating, in which 
the performance of the act can be reinforcing in itself, quite apart from 
the incentive properties of the goal object (Valenstein, Cox & Kakolewski, 
1970). 

It is striking that the stimulation of the same neural region can 
elicit either defensive attack or escape behaviour. Whether fight or flight 
occurs is independent of the peripheral shock delivered or the neural 
region stimulated but on other stimuli present at the time of punish- 
ment (Gray 1987). A single fight-flight system receives information 
about all aversive events. Whether escape or attack behaviour occurs 
depends upon the total stimulus context in which the electric shock or 
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brain stimulation is received. This notion is supported by the results of 
an experiment by Azrin, Hutchison, & McLaughlin (1965) in which mon- 
keys were able to pull a chain to present themselves with a ball. When 
they were shocked the monkeys pulled at the chain at a high rate and bit 
the ball. However, if the experimenter provided the animals with the 
opportunity to perform the escape response that terminated the shock, 
the monkey rapidly came to prefer that reponse than to attack the ball. If 
the escape response was made ineffective again, the monkey returned to 
the attack behaviour. Such results suggest that the expression of fight or 
flight responses depends on the particular stimuli present in the ani- 
mal’s environment when punishment is delivered. This implies the 
operation ofa single fight-flight mechanism which receives information 
about all punishments and then issues commands either for fight or for 
flight depending on the environmental context. 


Predatory attack behaviour and positive reward 


The preceding discussion dealt with mechanisms of defensive attack and 
did not consider attack behaviour of an appetitive nature. Studies on the 
cat indicate that stimulation of the lateral hypothalamus (LH) produces 
a predatory attack on a rat in which it silently stalks its prey, with hair 
sleeked back and no sign of fear (Wasman & Flynn, 1962). Self-stimula- 
tion of this region causes animals to show a very high rate of responding 
and suggests that it has positive reinforcing effects. Attack behaviour 
which produces such stimulation is closely connected with the act of 
eating or drinking, since these acts can be elicited by stimulation of the 
LH. Discussion of the role of LH in feeding and drinking is presented in 
Chapters 4 and 6, respectively. One can argue that predatory attack is 
essentially approach behaviour of the same kind as food-seeking or 
water-seeking. Roberts & Kiess (1964) found that if the LH stimulation 
was turned on when cats were eating, they switched their activity to 
attacking a nearby rat. This led them to conclude that attack behaviour 
of a predatory nature is positively rewarding. This contrasts with the 
effects of stimulation of the negatively reinforcing areas of the brain on 
the evocation of defensive aggression. 

The overlap in the anatomical sites regulating predatory attack 
and other consummatory activities such as feeding and drinking is 
extensive. Valenstein (1973) found that stimulation of such sites also 
elicits gnawing as well as exploratory behaviour in rats. In addition, 
Caggiula (1970) and Stephan, Valenstein & Zucker (1971) have shown 
that the elicitation of male copulatory behaviour and feeding can ob- 
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tained from the same electrode. The same electrode site can be used to 
stimulate consummatory activities as diverse as carrying of objects 
(Phillips et al., 1969), grooming and digging (Valenstein et al., 1970). 

Electrical stimulation of the fastigial nucleus of the cerebellum 
also produces multiple effects such as alertness, cardio-vascular reac- 
tions, grooming, feeding and attack behaviours in the cat (Reis, Doba & 
Nathan, 1973). The intensity of the electrical stimulation and the avail- 
ability of the goal object rather than the location of the electrode 
influenced the identity of the behaviour. For example, if a rat and food 
were both available, the cat shows attack behaviour, but in the absence 
of a prey, the cat would eat. These results once again demonstrate that 
the nature of the behaviour evoked from a single electrode at a fixed 
stimulus intensity can be changed by altering the availability of goal 
objects. This supports Valenstein’s (1973) views on the plasticity of the 
central neural organisation of some behaviours. However, it should be 
emphasised that predatory behaviour and defensive attack behaviour 
reflect different motivational, hence physiological, substrates. Although 
the physiological mechanisms underlying predatory attack have much 
in common with those concerning feeding and grooming, they have 
little in common with the physiological basis of defensive attack. Per- 
haps these substrates are organised along the lines of appetitive and 
aversive events. 


AVERSIVE STIMULI AND MOTIVATION SYSTEMS IN HUMANS 


Like non-human animals who are exposed to aversive stimuli, humans 
also respond to such events by removing themselves from the source of 
unpleasantness or by attacking the source if the first option is made 
difficult. Exposure to noxious stimuli elicits stress responses such as 
muscle tension, hypertension and heart rate increase in humans as they 
do in animals. Cues in the setting that are associated with these sources 
elicit a state of fear or anxiety which are comprised of the set of internal 
stimuli associated with stress. Gray (1987, p. 204) defined anxiety as ‘that 
emotional state which is elicited by stimuli associated with either pun- 
ishment or non-reward’. These kinds of stimuli are termed ‘anxiogenic’ 
and drugs that reduce their impact are descibed as ‘anxiolytic’. Human 
modes of emotional reaction may be essentially similar to those of 
animals. Anxiolytic drugs such as alcohol and barbiturates affect the 
behaviour in animals as they do in humans. Gray regarded the parts of 
the brain that mediate responses to anxiogenic stimuli as belonging to 
the BIS discussed in the previous section. 
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There is certainly widespread use of alcohol, barbiturate and 
anxiolytic drugs such as benzodiazepines among people faced with 
difficulties. Such difficulties rarely involve the sort of punishing stimuli 
that cause ‘fear’ but instead, involve frustrated hopes and/or unfulfilled 
expectations. Gray (1987) considered the septo-hippocampal system the 
first place to examine when studying differences between people with 
high or low levels of susceptibility to anxiety because these structures 
form the corpus of BIS functioning. This was based on the study of 
Reiman et al. (1984) using positron-emission tomography (PET) scanning 
as a method of visualising activity levels in various brain regions. Pa- 
tients suffering from spontaneous attacks of panic differed from con- 
trols in the inputs and outputs of the septo-hippocampal system. 

Although benzodiazapine and related drugs are used to treat 
anxiety disorders, they act only to suppress these reactions temporarily. 
Gray (1987) saw more hope with behaviour therapy treatment because 
of the many studies which he reviewed indicating how rats increased 
their resistance to frustrative non-reward through PRF training, as to 
punishment through the partial punishment schedule. Such contingen- 
cies of exposure to anxiogenic events lead many people to toughen up 
emotionally. 


Sources of human aggression 


The most widely cited classification of sources of aggression is that of 
Moyer (1977, 1980) who distinguished among different systems of ag- 
gressive behaviour on the basis of their arousing stimuli. One of his 
classifications, irritable aggression, concerns behaviour that is aroused 
by a range of aversive conditions, such as painful ones. He also proposed 
fear-induced aggression as another category. These forms of aggression are 
comparable to those of defensive aggression discussed earlier. They are 
documented by findings indicating that pairs of rats can be induced to 
fight by painful electric shocks and that a monkey that receives a shock 
may learn to pull on a chain to produce an object that can then be 
attacked (Azrin et al., 1965). Comparable studies on humans involve 
someone insulting a subject, or otherwise treating him or her badly. A 
little later, the subject that has a chance to deliver electric shocks to the 
insulting person, is more likely to deliver shocks than subjects who had 
not been insulted. It should be noted that in such experiments, the 
subject only thinks he or she is delivering shocks, whereas in fact no 
shocks occur (Berkowitz, 1983, 1989). The likely reason for such agonistic 
behaviour is the activation of a defensive motivation system akin to that 
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encountered when we examined the effects of the medial hypothalamus 
stimulation on rats. 

Hunting animals is a popular activity among many humans in the 
past as well as the present. In modern times such activity ranges from 
the fox-hunt in England, wild game hunting in North America, to Afri- 
can safaris. Despite protests from animal rights activists, hunting is an 
activity actively sought by many males who live in an urban setting. 
Wallace (1979) described hunters from Los Angeles who pay dearly for 
the privilege of being flown in with their high-powered rifles to Santa 
Cruz Island to kill the hapless descendents of the domestic sheep that 
were once raised on the island. The killing cannot be for the stringy meat 
of these animals; it seems to be done for the pleasure of killing. In 
analysing the evolution of hunting, Washburn & Lancaster (1968) stated 
that ‘men enjoy hunting and killing’. The opportunity to hunt wild 
animals serves as an incentive for instrumental activity. Hunters exhibit 
instrumental activity which precedes the actual consummation of the 
predatory kill. There appears to be reinforcement or reward from the 
accomplishment of such an act. Is this an expression of the motive of 
predatory aggression which we discussed in the section on physiological 
mechanisms in animals? 

Predatory attack behaviour is usually regarded as a class of behav- 
iour in which the animals that spontaneously kill, such as cats, are 
influenced by a complex motivational system which is independent of, 
although linked to, alimentary and aggressive mechanisms (Zagrodzka 
& Fonberg, 1978). It also involves a strong hedonistic component in the 
sense that there appears to be ‘enjoyment’ or ‘pleasure’ experienced in 
the act. Although one might view predatory attack in carnivores as a 
means to secure food, Zagrodzka & Fonberg’s (1997) summary of their 
laboratory findings indicate that food motivation is not necessary to 
drive such behaviour. These researchers proposed that some forms of 
human aggression may be understood from the perspective of the ani- 
mal model. Predatory behaviour, in the sense of chasing and finally 
killing the prey, is rewarding to a cat, and might be functionally auton- 
omous from the feeding motivation. In this respect, predatory behav- 
iour resembles human intrinsic aggression in which the ‘organism’s 
satisfaction appears to be intrinsic to the aggresive act itself (Feshbach 
& Fraczek, 1979). The reinforcement may be associated with the inflic- 
tion of pain or with the performance of an aggressive response. Fraczek 
(1992) has also argued ‘aggression for pleasure’ is based on reward 
mechanisms. 
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Homicide 


Homicide (humans killing other humans) is a mystery. Intraspecies 
aggression occur in other animals, but normally it seldom gets carried to 
the ‘bitter end’. The classic analysis by ethologists such as Lorenz (1971) 
and Tinbergen (1968) explains this anomaly of extreme intraspecies 
aggression as follows. Animals like humans compete for resources and 
status, for the reasons elaborated in Chapter 2. When the outcome of 
these agonistic encounters is established (there is a ‘winner’ and a 
‘loser’), there seem to be behavioural reactions by the winner triggered 
by built-in signals that are innately displayed by the loser. The latter 
displays submissive gestures that serve to inhibit the release of aggres- 
sive behaviour by the former. For example, in dogs and wolves, the 
defeated animal assumes a posture which exposes its neck to the winner. 
Similarly, a jackdaw abandons his attack and preens the intended victim 
when the latter turns his head, thus exposing his silver nape feathers. In 
both cases, attack by the victor is inhibited by these stimuli. Such 
mechanisms are lacking in humans. 

The more ‘modern’ evolutionary psychology approach to homicide 
is exemplified by that of Daly & Wilson (1988, 1994) whose position is 
that the act of murder is not an adaptation, but a manifestation of the 
human mind that has been adapted in such a way that, under certain 
circumstances, murder is a likely outcome. It is not the behaviour itself 
but the psychological mechanisms that bring it about which is of inter- 
est to these researchers. There are some consistent patterns of gender 
and age and motive that describe the homicidal population. Homo sapiens 
is clearly a creature for whom differential social status has been asso- 
ciated with variations in reproductive success. In traditional societies, 
men of high rank had more wives, concubines and access to other men’s 
wives than men of lower social rank. As a result such men had more 
children and their children survived better. As discussed in Chapter 2, 
the situation in modern industrialised societies is that there is an 
inverse relationship between class and status and number of children 
produced. Perusse (1993) suggested that the greater use of contracep- 
tives among the more educated higher status males is one of the reasons 
for the modern situation, and had there not been this invention, the 
situation would be similar to that in traditional societies. The proximate 
causal factor that is driving all this is ‘pleasure’, and high status profes- 
sional men (at least among his francophone sample in Montreal) seem to 
have more opportunities for sexual encounters than the less affluent. So 
what has been selected is not the conscious desire to leave behind more 
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children but the propensity to engage sexual activity for its own sake as 
well as the status associated with it among men 

In early Homo sapiens, individuals’ competitive success or failure 
would have enhanced their reputation among each other, and this could 
affect their total lifetime survival and reproductive success (Daly & 
Wilson, 1994). Demonstrations of bravery in the face of danger and 
before an audience enhances a male’s reputation. One of the motives of 
modern male-male homicide is the defence of status, reputation and 
honour in the local peer group. A seemingly minor affront can enrage 
young men to engage in violent encounters. Daly & Wilson (1988) claim 
that in most milieus, a man’s reputation depends upon the maintenance 
of a credible threat of violence. They cite 1975 homicide statistics in the 
United States that indicate that youth from puberty to the mid-twenties 
constitute the group that is most victimised and also the instigator of 
violence. Daly & Wilson (1994) regarded this demographic class as the 
group upon which there was the most intense selection for confronta- 
tional competitive capabilities among our ancestors. The group commit- 
ting the most murders are young men engaged in trivial altercations 
and some getting killed as a result. 

The next most frequent basis of homicide is within the family. If 
the implication is that murderers kill their kin, kin-selection theory is in 
trouble. But when Daly & Wilson (1988) examined the reports from 
American and Canadian sources, it turns out that most ‘family’ victims 
were the murderer’s spouse. Sexual jealousy seems to be the motive that 
triggers such aggression and homicide. Men who kill their partners 
typically do so under two key conditions - the observation or suspicion 
of sexual infidelity or when the woman is terminating a relationship. 
The first places a husband with a family at risk of investing his limited 
resources in an offspring to whom he may not be genetically related. The 
second represents the loss of a productively valuable mate to a rival, 
which represents a loss in the currency of fitness. Although men do not 
carry such evolutionary logic in their heads, they do carry the psycho- 
logical mechanisms that led to their ancestors’ success. This can fuel 
sexual jealousy and proprietariness over mates, both of which can lead 
to aggression. The results of interviews with 277 women who had been 
assaulted by their husbands led support to the hypothesis that violence 
by men is used as a strategy for controlling their mates, with the goal of 
preventing sexual access to other men or a defection in their relation- 
ship (Wilson, Johnson & Daly, 1995). Violence against women is depend- 
ent upon the specific adaptive problem being faced by the man. 
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SUMMARY 


Aversive stimuli elicit adaptive reactions such as withdrawal or attack 
directed at the source of the stimuli. Animals acquire a conditioned 
response, namely fear, to cues or warning signals associated with aver- 
sive stimuli, and also learn successful avoidance responses that reduces 
the fear. A more evolutionary based explanation suggests that successful 
escape or avoidance responding does not strengthen a new response, but 
that the animal is programmed to make specific responses when 
threatened with danger. What is learned is that certain situations are 
dangerous, and that a specific member of a class of species-specific defensive 
reactions is effective. 

Although some stimuli are more closely associated with fear than 
attack, and vice versa, a range of stimuli may evoke either reaction. 
Much depends upon the environmental context, and the animal’s previ- 
ous encounters with such stimuli. In addition, the occurrence of non- 
reward in situations where animals have experienced reward also has 
aversive effects. Gray’s (1987) model indicates parallels between the 
effects of punishment and those of the omission of anticipated reward in 
their behavioural as well as physiological manifestations. This model 
also distinguishes between mechanisms dealing with unconditioned 
aversive reactions (the fight-flight system) and those with conditioned 
aversive stimuli (the BIS). 


Downloaded from https://www.cambridge.org/core. Cambridge University Main, on 02 Dec 2019 at 19:19:06, subject to the Cambridge Core 
terms of use, available at https: Gambndge Books Online © Gambridge/UniversijoPress | 20405.009 


